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Abstract 

We propose a method for an improvement of auditory BCI (aBCI) paradigm based on a combination 
of ASSR stimuli optimization by choosing the subjects' best responses to AM-, flutter-, AM/FM and 
click-envelope modulated sounds. As the ASSR response features we propose pairwise phase-locking- 
values calculated from the EEG and next classified using binary classifier to detect attended and ignored 
stimuli. We also report on a possibility to use the stimuli as short as half a second, which is a step 
forward in ASSR based aBCI. The presented results are helpful for optimization of the aBCI stimuli for 
each subject. 

1 Introduction 

Brain computer interface (BCI) is the technology which can allow for an operation of any computerized 
devices without any muscle activity [l] . State of the art BCIs are implemented based on a classification of 
feature values extracted from brain activities, but their accuracies still not allow for broad applications. 
Therefore, there is a need for improvement of the classification accuracy for a better quality interfacing 
applications. Recent and hot research projects for the improvement are related to an auditory BCI 
(aBCI) , which is a method applying auditory evoked responses ( AER) generated by corresponding sound 
stimuli such as auditory steady-state response (ASSR) . Even though the contemporary studies report 
on relibable classification accuracy, there is still a plenty of room for the improvement |3j. 

There are several types in BCI shown as Figure [l][l]|4]. The applications can be divided into two 
types: invasive- and non-invasive BCI. Invasive BCI has usually a lower signal to noise ratio (SNR), 
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but it requires a surgical operation of skull to embed the electrodes on/in cortical surface. Contrarily, 
non-invasive BCI can be used by attaching electrodes on surface of human head, but the SNR is lower 
than in case of invasive technology. Therefore, in case of the non-invasive BCI development of accurate 
applications is more challenging. The next difficulty is related to simple interfacing paradigms design, of 
which imagery one based on user's intentional brain waves modulation caused by imagination/planning 
of certain actions (imagery movement, etc.) is the most popular one. As a solution to this problem is 
a method which applies brain responses to artificial sensory stimuli for generating the commands called 
a stimuli-driven BCI (see Figure [T]). For example, an user chooses to concentrate on one stimulus from 
multiple presented sequentially, which evokes a specific event related potential (ERF) pattern called 
"aha-response" or F300, since it is a positive EEG deflection around 300ms after the stimuli onset [s]. 
The BCI application classifies the responses and translates them into computerized commands. In case 
of aBCI the ERFs evoked by the auditory stimuli are utilized. 

The presented research focuses on the aBCI paradigm based on an auditory steady-state response 
(ASSR), which is usually used by physicians as a method for a hearing level estimation and it is 
evoked by periodic modulated sound. While a subject is listening the sound, the brain EEG response 
synchronizes with the amplitude modulating frequency. Therefore, a spectral peak in EEG appears at 
the same frequency as the modulating one. In addition, it was shown that while the subject concentrates 
listening to the sound stimulus, the response power rises i2 . The difference allows for a classification of 
the responses into targets and non-targets. The target refers to the chosen stimulus and the non-target 
to the ignored one. 

Applying this feature, Higashi et al. js] designed an aBCI, which was named an ASSR BCI. That 
paper has preliminarily proven the efficiency of ASSR BCI, however, there is still necessity for further 
improvement before a successful application of the paradigms with patients in need. 

In case of the classical ASSR based subjective hearing level estimation, there are studies showing 
that ASSR could be evoked by various modulation types, yet sinusoidal-amplitude-modulation (SAM) 
remains the most common choice in medical ASSR applications [2]. However, the hearing level estimation 
is often conducted while a subject is sleeping 2j6 , thus there is no attentional related response modulation 
possible. In other words, SAM sounds can cause large ASSR even when the subject is unconscious. This 
feature is not desirable for the BCI application focusing responses to attentionally differentiated targets 
and non-targets. Therefore, it is a need to further research on more efficient stimuli types for ASSR 
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based BCI. 

An additional problem that shall be resolved is related to the optimization of stimulation length. The 
stimuli should be long enough to evoke ASSR. However, if the longer stimuli are used, the inter-commands 
intervals will be also extended resulting in very low information-transfer-rates (ITR). Also the slower 
interfacing experience caused by longer stimuli interval downgrades the interfacing experience for the 
users. 

Moreover, the longer stimuli interval would be an obstacle in development of an application based on 
multi-commands BCI. Therefore, we aim to find the optimal stimulation length for the ASSR BCI. 

In this paper we report on our research comparing the ASSR classification results for various sound 
stimuli types and lengths. 

2 Methods 

In this section, first we describe ASSR stimuli used for our BCI experiments. Next we discuss EEC signal 
processing and classification steps. 

2.1 The Conventional ASSR Stimuli 

The state of the art ASSR BCI, as reported in (Sl, could be built for a two commands interface based on 
SAM. SAM signal Si{t) is obtained as 

si{t) = sin(27r/ct) sin(7r/,„t), (1) 

where t is a time-course, fc is a carrier tone frequency, and the fm is an envelope modulation frequency. 
An exemplary waveform is shown in Figure [2] In contemporary ASSR trials the stimulation length is 
usually 5s or longer. 

The conventional ASSR BCI application [s] delivered the sound stimuli to the user from two different 
spatial directions one-by-one via headphones. The directions corresponded to modulation frequencies (for 
example, SSHz stimulus from the left channel and 60 Hz from the right one). The user chose a command 
by concentrating on one of the directions, while ignoring the other one. BCI application extracted the 
feature values from the monitored simultaneously EEC data. In a next step the features were classified 
leading to a resulting command. It was shown for the 10 subjects that a classification accuracy was in a 
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range 62%-100% for the binary ease. Those resuhs are a proof of concept that the ASSR based BCI is 
a promising technology, yet the authors also pointed a necessity for further development. 

2.2 The Proposed Alternative ASSR Stimuli Types and Lengths 

We aim to improve the ASSR BCI by optimizing the stimuli types and their lengths. We test three new 
AM envelope types, which shall improve ASSR detection in EEC The three new modulation envelopes 
are described in next sections and followed by a discussion of shorter stimuli lengths comparing to 
conventional ASSR applications. 

2.2.1 The novel envelope modulation types 

We test the following three new modulations types: flutter AM (FAM), periodic clicks and combination 
of AM and FM ("AM/FM") modulations. The FAM stimulus S2(0 is obtained as follows, 

sin(27r/ct) sin(27r/™t) (sin(27r/„i) > 0) 
S2[t) = < (2) 

(otherwise) 

where fc is the carrier frequency and fm is the modulating envelope one. The resulting exemplary 
waveform is depicted in Figure [3] Usually brain responses captured in EEG are easier to distinguish from 
more obvious changes like in case of pulses or transitions from silence to louder auditory sensation |5j . 
The FAM stimuli with silent intervals is based on the above observations. We expect the EEG features 
extracted from responses to the FAM stimulus to reflect the effect of surprising sound resulting with 
simpler classiflcation of attended targets. 

A periodic clicks stimulus generates periodic click sounds with the same number of ticks as the 
frequency value. The stimuli are generated from discrete train of neighboring 1 and —1 values in each 
click interval as presented in Figure |4] In this paper, the frequency of clicks is defined as modulation 
frequency for easy comparison with the remaining ASSR stimuli types. Click stimuli also have an effect 
as the surprising sound for the experimental subjects. Moreover, the click stimulus is easier to attend or 
ignore by the subjects due to its very transient and broad frequency nature. 

Finally we also propose the AM/FM based combination of signals to generate the ASSR envelope 
modulation based stimulus. This allows us also to check possibility to utilize frequency modulated tones. 
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The AM/FM modulated ASSR stimulus S3{t) is generated as follows: 

sin(27r/cit) sin(7r/„t) (sin(7r/„ii) > 0) 
sin(27r/c2i) sin(7r/„jt) (otherwise) 

where /d and fc2 are frequencies of the two carrier sounds, as it can be seen in Figure [5| The two 
different tones sound alternate synchronizing to create an AM envelope similar in shape as in case of the 
classical SAM stimulus in equation ([T]). AM/FM sound is more friendly for the subjects comparing to the 
simple SAM tone, since it has a more friendly alternating (musical) temporal structure. Therefore, we 
hypothesize, that application of this novel stimuli to the auditory BCI shall result in more comfortable 
interfacing experience. 

2.2.2 The various stimuli lengths 

The shorter stimuli for multi-stimuli paradigms, based alternating time sharing protocol, usual result with 
better ITR. For example, time to present all commands in order to generate the final successful command 
becomes shorter. That also results in lower burden or tiredness of the subjects. On the other hand, if 
the stimuli would be too short, the machine learning algorithms would not be able to detect the ASSR. 
We propose to evaluate the three stimuli lengths, which are still shorter comparing to the conventional 
lengths. The experiments conducted in this paper are with 0.5s, Is and 3s lengths. In out preliminary 
experiment, reported in |4|, the 5s long stimulation forced subjects to concentrate for a long time. That 
resulted in increased tiredness and sleepiness causing a drop in interfacing efficiency. Therefore, based on 
the above mentioned previous experience, in this paper we attempt only to use shorter stimuli intervals 
than 5s. The comparison shall be helpful to optimize a tradeoff between the classification accuracy and 
the interfacing comfort for the subjects. 

2.3 EEG Experiment in Offline BCI Setting 

We conducted EEG experiments to record EEG for further offline analysis of the responses to various 
stimuli types and lengths. The purpose is to find how much the changing experimental conditions affect 
the ASSR variability for targets versus non-targets discrimination. 
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2.3.1 EEG experimental settings 

The EEG experiments were conducted with five subjects who agreed to participate voluntarily. The 
experimental protocol was designed in accordance with our local institutions ethical committee and 
WMA Declaration of Helsinki guidelines. 

In the experiments, the number of stimuli types was set to four as follows: SAM as in 0, FAM as 
in ([2|, periodic chcks, and AM/FM as in 

The number of stimuli lengths was set to three: 0.5s, Is and 3s. 

The stimuli were generated from three spatial directions which have corresponding modulation fre- 
quency: the 25Hz modulated stimulus is always delivered only from the left channel; the 60Hz one from 
the right; and the 40Hz one from the both channels creating an illusion of a center location. The carrier 
tones for SAM and FAM stimuli were set to 440 Hz. The AM/FM carrier tones were set to 440 and 880 
Hz alternating tones. 

EEG was recorded using a 16 channel g.USBamp amplifier by g.tec. The 16 active wet electrodes 
were attached to the following scalp locations F3, F4, CI, C2, C3, C4, C5, C6. T7, T8, CPl, CP2, PI, 
P2, Pz, and Cz, as in 10/10 system layout [t] (see Figure [6]). The reference was connected to the left 
earlobe. The ground was connected to the FPz scalp location. The recorded EEG at each electrode was 
preprocessed by application BCI 2000 as follows. The sampling rate was set to 512Hz and the digital 
filters were set to pass EEG frequencies in a range of 5 — lOOHz. A notch filter to remove electric power 
lines interference of 50Hz was set in a band of 48 — 52Hz according to the the East Japan power stations 
specifications. 

2.3.2 EEG experimental procedure 

The offline BCI experiment is conducted as follows. Three frequencies stimuli are presented at random 
order from each of the three different directions via inner-headphones (see Figure [?]). Presentation of the 
above three stimuli constitutes a single trial. We conduct experiments with each subject for 30 trials. 
During the first 10 trials, a subject is instructed to concentrate only to the left direction with the target 
stimuli and ignore the others as non-targets. In the next 10 trials - the center location is a target. Finally 
in the remaining 10 trials - the right direction is a target. 

The interval of breaks between each offset of a stimulus and onset of next one is set to 375ms. There 
are also longer breaks between each of 10 trials sessions. The above procedure is repeated for each of 12 
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stimuli variation (three different lengths and four types). 
2.4 EEG Data Processing 

EEG data recorded on offline BCI mode during our experiments are next processed in order to extract 
features necessary for easy comparison of target versus non-target. The feature is necessary for a final 
classification leading to the BCI commands. 

2.4.1 ASSR features extraction from EEG 

As the feature value, we use a phase locking value (PLV) 8 . PLV outperforms the other tested methods 
of discrete Fourier transform (DFT) and coherence analysis. 

PLV quantifies phase coupling between two signals which are recorded at different electrodes. When 
the two EEG signals are coupled, a hypothesis could be drawn that they originate from the same brain 
source or they are related to the same perceptual or cognitive process. In case of the very noisy multi- 
channel recordings such as EEG signals, a strong signal distributed among many electrodes is expected to 
result in multiple phase couplings. Unlike the amplitude based methods, such as coherence analysis, PLV 
can detect the signal which has a very tiny amplitude, like ASSR, buried in a very low SNR recording 
environment as in case of EEG captured from the human scalp. 

PLV is obtained as follows. At first, we apply a bandpass filtering to target only the interesting 
frequencies of the given signal Xa{t), which is recorded at the a'^'-electrode. The filter band is set from 
{fm — 2)Hz to {fm + 2)Hz. Next we construct an analytic signal for each electrode signal Xa{t) as r]a{t): 



r]a{t)^Xa{t)+iXa{t), (4) 

where i is an imaginary unit and Xa{t) is the Hilbert transformed version of Xa{t). Next with an instan- 
taneous phase 9a{t) and a radius R{t) the equation Q can be substituted by the following formulation: 

Xait) + liait) = Rit) exp{i0a{t)). (5) 

From to the equation ([5]), da{t) which is an instantaneous phase of the original signal Xa{t), is obtained 
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as 



Oa{t) = arctan 



Xgjt) 



(6) 



Finally, the difference between instantaneous phases of two signals Xa{t) and Xb{t) is defined as A9a,b{t) 
and it is obtained as, 



where n and m are ratio of synchronicity between Xa{t) and Xb{t). In case of a single brain source 
detection from EEG, n : m equals 1 : 1, leading to m = n = 1. 

Practically, the PLV is quantified by averaging of the unit vector ex.p{iA9a^b{t)) over time. Therefore, 
in case of discrete signals, PLV is obtained as 



where L is the length of the analyzed signal window. In our case L equals to the stimulus length. The 
PLV is normalized between zero and one. The zero means that Xa{t) and Xb{t) are not coupled at all. 
The PLV equals to one means that the two analyzed EEG channels are perfectly coupled in the narrow 
analysis frequency band. 

We calculate PLVs for each ASSR in EEG and for all pairwise combinations of the 16 electrodes. As 
a result from the whole experimental session, we obtain 90 (3 x 30 trials) PLV sets from all stimuli types 
and lengths. Each PLV set contains 120 features ((2^) combinations), because PLVa,6 = P'LMb,a and 



Finally, we create a 120-dimensional feature vector f for the classification of the each fc*'' stimuli as 
follows: 



Ma,b{t)=n9a{t)-m9b{t), 



(7) 




(8) 



PLV, 



a.a 



1. 



ffc = [ PLt/1.2, PLFi,3, 



PLV2,w, 



(9) 



Pm5,16]. 
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2.4.2 Classification Method 

For the classification, we use a method of naive Bayes classifier (NBC) ^ applied in leave-one-out cross- 



validation mode using NaN-toolbox 10 . The NBC method is rated as the best in comparison with linear 
discriminant and regression analysis based classification techniques [9]. 

We contact a comparison among various stimuli types and lengths as in the following approach: 

• First, we try to find out how much the target versus non-target detection is affected in various 
experimental conditions. 

• Second, we compare whether we could discriminate targets based on different acoustic source loca- 
tions. 

The first test is to confirm ASSR difference between targets and non-targets. This result is obtained 
from classification result in each stimulation with responses labeled as targets and non-targets, based on 
experimental instruction given to the subjects. This test is based on a separation of the 90 responses into 
three direction classes: left, right, and center. We obtain 30 samples for each direction class: 10 samples 
are labeled as tor(7et-direction and the remaining 20 become the non-target-directions. 

The latter test is conducted to confirm the accuracy of ASSR BCI commands. The responses from 
each single trial are labeled into three classes of: left, center, and right directions. We combine the three 
feature vectors of each trial and redefine that as a single sample. Therefore, there are 360 features for 
each stimuli and 30 samples for each type and length (10 samples labeled as left; 10 as center; and 10 as 
right). 

In the both tests, the classifier for a single condition is independent from the others. 



3 Results 

For the comparison among different experiments, we use a value of classification accuracy (CA) resulting 
from the leave-one-out cross-validation conducted in a single condition. CA is defined as a rate of the 
number of the correctly classified ASSR responses to the all in a single experiment. 
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3.1 Classification Results in target versus non-target Setting 

The results of classification for target versus non~target are shown in Figures [8] and [9] Figure |8] contains 
a plot of CA averaged over all subjects for the comparison between stimulation lengths. The detail values 
are shown in TABLE [T] According to the all lines in that figure, the longer stimulation, the better CA 
becomes, so shortening ASSR stimuli below 3s is not advised from ASSR BCI. Additionally, the SAM 
stimuli seems to be the best in averaged responses. 

Figure |9] presents a plot of CA presents only results from the best stimuli length of 3s length for 
the comparison of various modulations. The detail values are shown in TABLE [2j The results show no 
significant differences among the tested ASSR generators of SAM, FAM, periodic clicks, and AM/FM. 
This is a very encouraging news that ASSR could be evoked with various periodic sound stimuli. That 
could enhance BCI interfacing experience by lowering possible weariness or habituation to a monotonic 
repetitive sounds. 



3.2 Classification for Targets Direction 

The results of classification for target direction within a single trial are shown in Figure[lO]for a comparison 
between stimulation lengths and in Figure [TT] among various modulation types. The detail values of 
Figure 10 are shown in TABLE [3] and those of Figure 11 are shown in TABLE |4) The same as in the 



above target versus non-target comparison results. Figure 10 is created from the averaged results from 
all the subjects. Figure [Tl] is also generated from the 3s long stimuli to compare stimuli types variability. 



There is also no significant difference among the averaged results in Figure 10 On the other hand, the 
stimuli types cause differences in ASSR as shown by dotted lines in Figure 10 According to Figure [TTj the 
responses to SAM stimuli result with subject independent accuracies comparing to the other ASSR. On 
the other hand, there are better stimulus types than SAM according to the accuracies for each subject. 
When we average the accuracies over the best stimulus types for each subject, the result will be 78.00%. 



4 Conclusions 

Based on the conducted EEC experiments in offline ASSR BCI mode, it has been shown that the stimu- 
lation length of 0.5 second has been just above a chance level, as resulting from the NBC classification in 
leave-one-out cross-validation mode. Therefore, the 0.5s stimulus is too short to cause ASSR possible to 
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classify in a BCI setting. On the other hand, the classification accuracy seems to increase monotonically 
together with the stimulation length. The encouraging results for the 3s long stimuli, where the accuracy 
seems to start to saturate already, are a step forward comparing with the state of the are ASSR BCI 
applications. More research is necessary in this ASSR stimuli range to determine with higher accuracy 
the optimal stimuli lengths. 

A comparison of the various modulation types has been resulted with the outcome, that actually the 
conventional SAM based ASSR is the best for the three subjects out of the five tested. This result has 
shown that subject dependence is a very strong factor in aBCI design and the subjects shall be tested 
for their best and preferred responses. According to presented results, while the average classification 
accuracy for SAM has been 70%, the best stimuli type for each subject has scored 78% on average. This 
performance is already adequate for practical BCI application, yet there is still plenty of room for possible 
improvement. 

A single subject had better results for AM/FM and clicks based ASSR comparing to SAM. Those 
particular two stimuli types have different carrier frequencies comparing the the simple SAM stimuli. 
This results suggest that there is a possibility that the carrier sound could influence the results. The 
additional research topic shall be investigated to optimize the carrier sounds of the ASSR for each user. 

Additionally, the modulation frequencies and stimuli directions has been unified for all the subjects 
in our experiments. The classification results could be improved by optimization of them for the subject. 
This will be also a topic of our future research. 

On the other hand, optimizations for each user require long time for machine leaning before his/her 
first use of practical and successful online BCI. Therefore, other approaches shall improve possibly user's 
convenience. 

For example, the electrodes position could be further optimized, since in our experiments we also 
unified them. In the presented study, the electrodes were distributed over the auditory cortices, tem- 
poral, parietal and frontal brain lobes. The PLV features has been calculated from the all electrodes 
combinations. However, in case of PLV, there is a danger that the very close positioned electrodes might 
results with unnecessary saturated values due to their close proximity. Therefore, it is expected that 
more significant feature vector could be given by optimization of electrodes positioning. 

In addition, we plan to extend or combine the ASSR with attentional alpha-wave modulation or 
synchronization with lower frequency steady-state responses, which already have shown in our former 
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research [4] to have stronger modulatory impact. The other choice could be an inclusion of hap- 
tic / somatosensory or bone-conductance based stimulation based on tactile exciters attached to the fingers 
or facial areas. 

The presented research is a step forward in development of novel BCI paradigms. We have confirmed 
and extended possibility to apply ASSR stimuli based on various stimuli for possible inclusion in practical 
online BCI applications. 
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Figure Legends 

Figure [l] Tree diagram of the BCI types. The BCI can be divided into invasive and non-invasive based 
on their implementation. Moreover, the non-invasive BCI can be divided into imagery and stimuh- 
driven depending whether the sensory stimulus is used or not. FoUowing the general division of 
sensation into five categories, there are also five types of the stimuli-driven BCls: visual; auditory; 
somatosensory; olfactory; and gustatory. 

Figure [2] A waveform of a 440Hz tone amplitude modulated with a sinusoidal shape envelope with a 
frequency of 40Hz. 

Figure [3] A waveform of a 440Hz tone amplitude modulated with a flutter shape envelope with a fre- 
quency of 40Hz. 

Figure [4] A waveform of periodic clicks which have no carrier frequencies due to their very transient 
nature. 

Figure [s] A waveform as a combination of amplitude and frequency modulations of 440Hz and 880Hz 
tones. 

Figure [6] The 10/10 system locations of EEG electrodes on a scalp. The graph is based on BIOSEMI's 
64-channels EEG cap layout. The red circles represent receding electrodes chosen for experiments 
reported in this paper. The blue square is a ground electrode. A reference was attached to the left 
earlobe. 

Figure [7] The experimental protocol presenting the stimuli distribution in each trial. The horizontal 
axis represents the time-course. The stimuli from a left audio channel are shown in blue and a right 
one in green. The stimulation spatial order in the figure in the first trial is center, next right, and 
finally left. In the second trial first left, next center, and finally right. 

Figure [s] Results of binary classification accuracies for target versus non-target setting for various stimuli 
types and an average of all subjects. 

Figure [9] A plot of classification accuracy based on modulation types for target versus non-target, for 
only 3 long stimuli and for each subject separately. 
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Figure |10| A plot of classification accuracy based on stimulation length for target directions with an 
average for all subjects. 



Figure 11 A plot of classification accuracy based on modulation types for target directions for only 3 



long stimuli and for each subject separately. 



Tables 

Table 1. Values of CA for target verses non-target based on stimulation length. 



ASSR stimuli type 


0.5s 


Is 


3s 


SAM 


60.67% 


66.44% 


74.44% 


FAM 


54.00% 


64.22% 


72.67% 


Clicks 


57.78% 


64.67% 


70.67% 


AM/FM 


57.33% 


61.33% 


71.78% 


Average of all stimuli 


57.44% 


64.17% 


72.39% 



Table 2. The values of CA for target verses non-target based on modulation types. 



Subject 


SAM 


Flutter 


Clicks 


FM 


#1 


72.22% 


80.00% 


70.00% 


73.33% 


#2 


86.67% 


81.11% 


58.89% 


77.78% 


#3 


71.11% 


82.22% 


90.00% 


88.89% 


#4 


77.78% 


62.22% 


61.11% 


57.78% 


#5 


64.44% 


57.78% 


73.33% 


61.11% 


Average of all 


74.44% 


72.67% 


70.67% 


71.78% 



Table 3. Values of CA for target directions based on stimulation length. 



ASSR stimuli type 


0.5s 


Is 


3s 


SAM 


36.00% 


47.33% 


70.00% 


FAM 


45.33% 


52.67% 


60.67% 


Clicks 


39.33% 


51.33% 


57.33% 


AM/FM 


37.33% 


40.67% 


64.00% 


Average of all stimuli 


39.50% 


48.00% 


63.00% 



Table 4. The values of CA for target direction based on modulation tj^pes. 



Subject 


SAM 


Flutter 


Clicks 


FM 


#1 


66.67% 


73.33% 


63.33% 


66.67% 


#2 


86.67% 


66.67% 


36.67% 


66.67% 


#3 


63.33% 


73.33% 


86.67% 


96.67% 


#4 


73.33% 


46.67% 


56.67% 


33.33% 


#5 


60.00% 


43.33% 


43.33% 


56.67% 


Average of all 


70.00% 


60.67% 


57.33% 


64.00% 



18 



Figures 



BCI 



non-invasive 



invasive 
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Figure 1. Tree diagram of the BCI types. The BCI can be divided into invasive and non-invasive 
based on their implementation. Moreover, the non-invasive BCI can be divided into imagery and 
stimuH-driven depending whether the sensory stimulus is used or not. Following the general division of 
sensation into five categories, there are also five types of the stimuli-driven BCIs: visual; auditory; 
somatosensory; olfactory; and gustatory. 
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Figure 2. A waveform of a 440IIz tone amplitude modulated with a sinusoidal shape envelope with a 
frequency of 40IIz. 
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Flutter Amplitude Modulation 
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Figure 3. A waveform of a 440Hz tone amplitude modulated with a flutter shape envelope with a 
frequency of 40Hz. 
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Figure 4. A waveform of periodic clicks which have no carrier frequencies due to their very transient 
nature. 
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Figure 5. A waveform as a combination of amplitude and frequency modulations of 440Hz and 880Hz 
tones. 
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Figure 6. The 10/10 system locations of EEG electrodes on a scalp. The graph is based on 
BIOSEMI's 64-channels EEG cap layout. The red circles represent receding electrodes chosen for 
experiments reported in this paper. The blue square is a ground electrode. A reference was attached to 
the left earlobe. 
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Figure 7. The experimental protocol presenting the stimuli distribution in each trial. The horizontal 
axis represents the time-course. The stimuli from a left audio channel are shown in blue and a right one 
in green. The stimulation spatial order in the figure in the first trial is center, next right, and finally 
left. In the second trial first left, next center, and finally right. 
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Figure 8. Results of binary classification accuracies for target versus non-target setting for various 
stimuli types and an average of all subjects. 
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Figure 9. A plot of classification accuracy based on modulation types for target versus non-target, for 
only 3 long stimuli and for each subject separately. 
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Figure 10. A plot of classification accuracy based on stimulation length for target directions with an 
average for all subjects. 
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Figure 11. A plot of classification accuracy based on modulation types for target directions for only 3 
long stimuli and for each subject separately. 



